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Abstract 

Detecting edges is a fundamental problem in computer 
vision with many applications, some involving very noisy 
images. While most edge detection methods are fast, they 
perform well only on relatively clean images. Indeed, edges 
in such images can be reliably detected using only local fil¬ 
ters. Detecting faint edges under high levels of noise cannot 
be done locally at the individual pixel level, and requires 
more sophisticated global processing. Unfortunately, exist¬ 
ing methods that achieve this goal are quite slow. In this pa¬ 
per we develop a novel multiscale method to detect curved 
edges in noisy images. While our algorithm searches for 
edges over a huge set of candidate curves, it does so in a 
practical runtime, nearly linear in the total number of image 
pixels. As we demonstrate experimentally, our algorithm is 
orders of magnitude faster than previous methods designed 
to deal with high noise levels. Nevertheless, it obtains com¬ 
parable, if not better, edge detection quality on a variety of 
challenging noisy images. 


1. Introduction 

This paper considers the problem of detecting faint edges 
in noisy images. Our key contribution is the introduction of 
a new, computationally efficient algorithm to detect faint 
curved edges of arbitrary shapes and lengths, under low 
signal-to-noise ratios (SNRs). A key feature of our algo¬ 
rithm is that the longer an edge is, the fainter it can be and 
still be detected. This is consistent with the performance of 
the human visual system, as can be appreciated from Fig. 1. 

Edges with low signal-to-noise-ratio are common in a 
variety of imaging domains, specifically when images are 
captured under poor visibility conditions. Examples include 
biomedical, satellite and high shutter speed imaging. Fig. 2 
shows an image of Plankton acquired with an underwater 
imaging system [5]. Exploring ocean ecosystems can bene¬ 
fit from algorithms for segmentation, detection and classifi¬ 
cation of plankton. Segmenting plankton in such images is 
challenging due to their low contrast and background noise. 



Figure 1. A noisy binary pattern with three curved fibers at high 
(left, SNR=1) or low (middle, SNR=2) levels of noise. The clean 
pattern is shown on the right. The long fiber is noticeable already 
at the low SNR. In contrast, the two shorter fibers can be spotted 
only at the higher SNR. 



Figure 2. From left to right: Noisy image of a Plankton acquired by 
an underwater imaging system [5] containing several faint edges; 
our result; Canny result, and Canny after BM3D denoising. The 
thresholds we chose for Canny are those that maximize its perfor¬ 
mance in our experiments. 


Noise poses an obstacle to edge detection since it can 
reduce the contrast of actual edges, and introduce spurious 
high contrasts at background pixels. As a result, common 
edge detection methods that are based on local image gra¬ 
dients are severely affected by noise. To be more robust 
to noise. Canny [7], for example, first denoises the image 
with a Gaussian filter, before computing its gradients. This 
smoothing operation indeed attenuates the noise, but also 
blurs existing edges, thus decreasing their contrast. Apply- 
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ing more sophisticated image denoising algorithms before 
edge detection does not, in general, solve the problem. We 
illustrate this point in Fig. 2. The edges found by Canny [7] 
on either the noisy image or the image denoised by the state- 
of-the art BM3D algorithm [9] are shown in the two right¬ 
most panels. Denoising prior to edge detection does not 
significantly improve the results. In contrast, the middle- 
left panel shows the edges detected by our method. 

Our approach is to detect faint curved edges by applying 
a large collection of matched filters to the image, and retain¬ 
ing only those which are statistically significant. By defi¬ 
nition, each of these matched filters computes the average 
contrast of the image pixel intensities along its correspond¬ 
ing curve. When this curve traces an actual edge, the filter 
smoothes the noise on either side of the edge while main¬ 
taining its contrast. Hence, this operation does not suffer 
from the degradation of the general purpose denoising ap¬ 
proaches described above. The longer the edge and its cor¬ 
responding matched filter, the more aggressively the noise 
is attenuated, allowing detection of fainter edges. 

The computational challenge in applying this approach 
is that the locations and shapes of the edges, and hence 
the corresponding matched filters are a-priori unknown. 
Moveover, there are in general an exponential number of 
candidate curves and corresponding matched filters. Hence, 
a naive direct approach to compute all of them would be 
prohibitively slow. The main contribution of this paper is 
the development of a highly efficient algorithm to detect 
curved edge. This is achieved by dynamic programming 
on a hierarchical binary partition of the image. With this 
construction, even though our algorithm searches for edges 
over a huge set of candidate curves, it does so in a practical 
runtime, nearly linear in the total number of image pixels. 
As we prove in Sec. 4, our algorithm is orders of magni¬ 
tude faster than other edge detection methods that can deal 
with high noise levels. Yet, as we demonstrate in Sec. 6, it 
obtains comparable, if not better, edge detection quality on 
challenging noisy images, from a variety of applications. 

2. Previous and Related Work 

Edge detection is a well studied problem with a rich his¬ 
tory. Traditional methods considered step edges and relied 
on local gradients to detect them [18, 15, 7]. In contrast, re¬ 
cent methods addressed the problem of boundary detection 
in natural images [16, 3, 2, 4, 10, 14]. These methods rely 
on supervised learning of complex boundary features that 
account for intensity, color and texture. Despite the high 
accuracy achieved by these methods on natural images, as 
shown experimentally in Sec. 6, they exhibit poor perfor¬ 
mance in noisy images with faint edges. 

In this paper we focus on the problem of detecting step 
edges at high levels of noise. As mentioned in the in¬ 
troduction, this is an important task in a variety of imag¬ 


ing domains. One of the first proposed methods for step 
edge detection was the Sobel operator [18], which does so 
by thresholding the gradient magnitude at each pixel sepa¬ 
rately. Marr & Hildreth [15] proposed to detect edges by 
identifying the zero crossings of a 2D Laplacian of a Gaus¬ 
sian filter applied to the image. These local approaches 
for edge detection are very efficient, essentially with linear¬ 
time complexity in the total number of pixels. However, due 
to their local nature, they are sensitive to noise and exhibit 
poor performance at low SNR. One exception is the algo¬ 
rithm suggested by Canny [7], which extends Sobel by hys¬ 
teresis thresholding of the local gradient magnitudes. This 
post-processing operation significantly improves its robust¬ 
ness to noise. We thus choose the Canny algorithm as a 
baseline for comparison to our work. 

A potentially promising approach to detect edges in 
noisy images is to first denoise the image and then apply 
some edge detection algorithm. The problem of image de¬ 
noising received considerable attention in recent years, and 
various methods were proposed, including bilateral filter¬ 
ing [19], anisotropic diffusion [17], non-local means [6], 
BM3D [9] and more. These methods, however, are not op¬ 
timized for edge detection and typically denoise the image 
based on small local patches. Hence, they may blur faint 
edges, making their detection even more difficult. 

Another set of edge detection algorithms utilize a 
Wavelet-based bank of filters that vary in length and width, 
see a review in [20]. Given the availability of fast-wavelet 
transforms, these methods are also quite fast. However, 
a key difference from our approach is that these wavelet 
methods do not adapt to the shape of actual curved edges. 
Hence, their performance at very low SNRs is sub-optimal. 

Several recent studies proposed to use matched filters to 
improve the detection of faint edges. Galun et al. [12] pro¬ 
posed an efficient algorithm for detecting straight edges, re¬ 
quiring 0{N log N) operations for an input image with N 
pixels. An even faster version for detecting long straight 
edges was proposed in [13], with sub-linear run-time in the 
image size. An algorithm for detecting faint curved edges 
was proposed by Alpert et al. [ ]. Relying on the Beamlet 
data structure [11], their method applied dynamic program¬ 
ming to a hierarchical, quad-tree partition of the image. The 
time complexity of their algorithm is 0{N‘^-^), which trans¬ 
lates into a non-practical runtime of several minutes on typ¬ 
ical images. 

In our work, we detect curved edges with a significantly 
reduced complexity. The two key ideas are to instead con¬ 
struct a binary tree partition, and perform a sophisticated 
processing on it. We present two variants of our algo¬ 
rithm, which both require a memory of 0{N\ogN). The 
first, more stringent variant has time complexity 
whereas the second faster one incurs a slight loss of detec¬ 
tion accuracy, but has even faster runtime at 0{N\ogN) 


2 


operations. For illustrative purposes, the run time of our 
latter algorithm, implemented in C++, is roughly 2 seconds 
on a small 129 x 129 image and 10 seconds on a 257 x 257 
image. In contrast, the runtime of [1], as reported in their 
paper is several minutes per image. 

3. The Beam-Curve Binary Tree 

In this paper we develop algorithms that efficiently ex¬ 
amine an exponential set of possible candidate edges. This 
section describes in detail how we achieve this goal. 

3.1. Setup and Notations 

The input of our method is a noisy gray-level image 
I with N = m X n pixels containing an a-priori un¬ 
known number of curved edges at unknown locations and 
shapes. For simplicity we consider square images with 
m = n where n is a power of 2. In developing our al¬ 
gorithm and its theoretical analysis, we consider an addi¬ 
tive Gaussian noise model. Namely, the input image can 
by decomposed as / = Idean + Inoise where Idean is a 
noise free image, with step edges of constant contrast, and 
^noise{^y) ^ N(0^(J ). 

An edge is a non self-intersecting curve 7 , with step dis¬ 
continuity in the pixel intensities of the unobserved Idean- 
Its SNR is defined as the absolute difference in image in¬ 
tensities across the step edge, divided by the noise level. To 
each candidate curve 7 , of total length L, passing through a 
set of pixels P, we associate the following response vector 

4>{i) = [R,L,C,P]. (1) 

The response value P, determined by the matched filter 
corresponding to the curve 7 , is the difference between 
the sums of intensities on either sides of the curve. The 
variable C = P/m(L) is the average contrast along the 
curve, where m(P) is the total number of pixels of the 
matched filter of length L. Given two curves, 71 and 
72 that share an endpoint, with the corresponding vectors 
^{li) — [^iiLi^Ci^Pi], i = 1,2, the response vector of 
their concatenation is 

0(71+72) = [^1+^2, P1+P2, - (T \ \ -77^: AUP2]. 

m(Pi) + m[L2) 

( 2 ) 

To detect curves with statistically significant responses, 
we construct the beam-curve binary tree of the noisy image 
I. This tree corresponds to a hierarchical partition of the 
image and an accompanying data structure, denoted BC, 
on which we provide more details below. Geometrically, 
each node of the tree corresponds to a tile in the image (a 
region of a prescribed shape). A tile V of area A, is split into 
two sub-tiles Vi , V 2 of roughly equal area by an interface (a 
straight line in our implementation) whose length is propor¬ 
tional to \/A. The root node, at level j = 0 represents the 


full image, whereas at each finer level j there are 2^ tiles. 
The tree is constructed up to a bottom level ji,, whereby 
all of its tiles have area approximately nmin x ^min, where 
^min (typically a few pixels) is a user chosen parameter. 

Within each tile V, for every pair of pixels pi and p 2 on 
its boundary dV, the data structure BC stores a response 
vector 0(7). Postponing exact definitions to Sec. 5, this 
response vector corresponding to a single curve 7 between 
Pi and p 2 , which is most likely to be an edge. See Alg. 1 
for a pseudo-code of the tree construction, and Fig. 3 for its 
implementation based on a rectangular tile partition. 

3.2. The Edge Detection Algorithm 

As described in Alg. 1, the matched filter responses of 
the various curves are calculated in a bottom-up fashion, 
from the leaves of the tree to its root. For each leaf tile 
V at the bottom level we set the response of each pair 
of boundary pixels pi, P 2 ^ dV to be the matched filter 
response of the straight line segment that connects them. 
See Alg. 2 for a pseudo-code of the bottom level processing. 

Next, given the response vectors at level j + 1 we com¬ 
pute responses at the next coarser level j. We do this by 
concatenating sub-curves from sibling tiles as follows. Let 
Vi, V 2 be sibling tiles at level j + 1, with a parent tile V at 
level j, and let V 12 = dVi D 9+2 be their joint interface. 
We consider all pairs of pixels such that pi G dVi D dV 
and p 2 G 9+2 H dV. Now, for each such pair of pixels 
(pi, P 2 ) 5 in the stringent variant of our algorithm, we con¬ 
sider all pixels in the joint interface V 12 . For any such pixel 
P3 ^ V 12 we compute the response of the curve obtained 
by concatenating the two sub-curves from pi to ps and ps 
to p 2 . Among all of these concatenated curves, we store 
the one with highest response score (defined explicitly in 
Eq. (11) below). See Alg. 3 for pseudo-code of the coarser 
level construction. 

The final output of our algorithm is a soft edge map im¬ 
age E. A value Eij = 0 means that there is no edge passing 
through pixel (i, j), whereas the higher the value of E^j, the 
stronger is our belief that an edge passes there. This edge 
map E is constructed as follows: We initially set all pixels 
of E to zero. For every response vector 0(7), as detailed 
in Sec. 5, we assign a significance score that depends on its 
mean contrast C and its length L. A positive score indicates 
that the curve marks a statistically significant edge. Then, 
we sort all the curves in the tree whose score is positive from 
highest score to lowest. For each curve 7 in this sorted list, 
for each pixel p G P we set E{p) to hold the score of 7 . To 
deal with overlapping curves with positive scores, we apply 
the following simple non-maximal suppression procedure: 
First, if at some pixel p, the current value E{p) is already 
positive, we do not decrease it; and, secondly, if most of the 
pixels in the P were already marked by previous curves (of 
higher scores), we discard the current curve 7 and do not 
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add its pixels to E. 

In principle, the generic algorithm above can be imple¬ 
mented with any binary partition of the image. In Sec. 4 we 
make a detailed complexity analysis, under the assumption 
that the children tiles are roughly half the area of their par¬ 
ent tile and the length of their interface is roughly the square 
root of their area. We prove that under these conditions, the 
algorithm complexity is 


Algorithm 1 BeamCurveTree{V) 

Require: Tile V whose maximal side length is n. 
if n < rimin then 

BC <r- BottomLevel{V) 

else 

Vi, V 2 ^ SubTiles(y) { The tile is split into two 
sub-tiles of equal area} 

BCi ^ BeamCurveTree{Vi) 

BC 2 ^ BeamCurveTree{V 2 ) 

BC ^ CoarserLevel{V,Vi,V 2 ,BCi,BC 2 ) 
end if 
return BC 


Algorithm 3 CoarserLeveliV^ Vi, V 2 , BCi^ BC2) 
Require: V is an image tile, Vi and V2 are its sub-tiles. 
Require: BCi is a set of the responses of sub-tile Vi. 
Require: BC2 is a set of the responses of sub-tile V2. 
BC ^ BCi U BC2 
if BasicMode then 

InterfaceSet ^ dVi fl dV2 
else if OptimizedMode then 

Inter faceSet ^ Best Pixel s{dVi D dV2) 
end if 

for Vpi, P2 • Pi ^ dV n dVi , P2 G dV D 5 V2 do 
AllResponses ^ EmptySet 
for Vps G Inter faeeSet do 

7 1 ^ curve from pi to ps in set BCi 

72 ^ curve from ps to p 2 in set BC 2 
0(7) ^ concatenate(0(71), 0(72)) 

All Responses.add{(j){^)) 

end for 

BC .add{ All Responses .best Response^)) 

end for 
return BC 


Algorithm 2 BottomLevel{V) 

Require: Small tile V. 

BC ^ EmptySet 
for Vpi, P 2 G dV do 

7 ^ straight line from pi to p 2 
BC.add{(t){-f)) 
end for 
return BC 


Rectangular partition. In this partition, we split the 
square image into two rectangles of equal size. We next split 
each rectangle into two squares and continue recursively un¬ 
til squares of a size nmin x ^min are obtained. Specifically 
in our implementation, we used nmin = 5. We call the ob¬ 
tained data structure Rectangle-Partition-Tree (RPT). See 
Fig. 3 for an illustration of the RPT levels. 

Triangular Partition. A second possible beam curve 
binary tree, which we denote as the Triangle-Partition-Tree 
(TPT), is based on triangular tiles, see Fig. 4. Here, at the 
topmost level we split the image along its diagonal into two 
triangles. Then, at any subsequent level we split each tri¬ 
angle into two sub-triangles recursively. For a square im¬ 
age, the triangles obtained are all right angled isosceles. It 
can be shown that the TPT-based edge detection algorithm 
is slightly faster than the RPT-based one. Specifically, for 
a square image of N pixels, the TPT algorithm requires 
« 14A^^-^ operations (derivation omitted due page limit re¬ 
strictions). In contrast, as we analyze in detail in Sec. 4 
below, the RPT construction requires « operations. 




Figure 3. Left: The 3 topmost levels of the Rectangle-Partition- 
Tree. Right: The n x n image at level j = 0 is partitioned into 
two rectangles of size n x n/2 at level j = 1. Each rectangle is 
then partitioned into two n/2 x n/2 squares at level j — 2. A 
curve going from two boundary pixels pi, p 2 of level j = 0 is a 
concatenation of up to 2 sub-curves of level j — 1, and up to 4 
sub-curves of level j — 2. 

Figure 4. Triangle-Partition-Tree, an alternative implementation of 
the beam-curve binary-tree. Left: The 4 topmost levels of the TPT. 
Right: The partitioning embedded in the 2D image grid, every 
triangle is divided into two sub-triangles. 

In addition, the set of potential curves scanned by both par¬ 
titions is of comparable size. Hence, both partitions yield a 
very similar edge detection performance. 
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3.3. An Optimized Version 

A run-time complexity of operations may still 

be too slow when processing large images. Hence, it is of 
interest to develop even faster algorithms. Below we in¬ 
troduce an efficient variant of our algorithm that achieves 
an 0{N log N) complexity, at a statistical price of slightly 
worse detection quality. 

In this variant, at each tile V of level j for every pair 
of points pi,P 2 ^ dV, the algorithm still seeks to com¬ 
pute the curve between them with best response. How¬ 
ever, instead of scanning all the points in the joint interface 
Vi 2 = dVi n dV 2 , it only accesses a subset of k pixels for 
some fixed constant k. To select this subset, for each pixel 
Ps ^ Vi 2 we look at the curve with highest response, that 
starts at either dVi or dV 2 and ends at ps, as already pre¬ 
viously computed at level j + 1. We then keep only the k 
pixels with highest responses. As we prove in Sec. 4, the 
overall required number of operations of this variant is sig¬ 
nificantly smaller. Our experiments in Sec. 6 indicate that 
in practice this results in a negligible decrease in edge de¬ 
tection quality. 

4. Complexity Analysis 

In this section we study the computational complexity 
of the beam-curve algorithm of Sec. 3.2. We begin with 
an analysis of the general algorithm as follows. Denote by 
f{A) the number of operations performed by our algorithm 
on a tile V of area A. Denote by Vi and V 2 the children 
tiles of V, Vi U V 2 = V. The step of populating the re¬ 
sponses of V involves computing responses for every triplet 
of pixels. Pi G dVl, p 2 G dV 2 andps G dVi D dV 2 . The 
length of each of these three boundaries is 0{\fA), and so 
the complexity of this step is proportional to The op¬ 
eration is then repeated for the sub-tiles Vi and V 2 whose 
areas A j 2. Therefore /(A) satisfies the following recur¬ 
sion, 

f{A)=2f{Al2) + 0{A^-^). (3) 

Since at the bottom level of the tree, /(nmin x ^min) = 
0(1), the master theorem [8] yields that /(A) = 0(A^-^). 
Finally, as the area of the root tile equals the total number of 
image pixels N, the overall complexity of the beam-curve 
binary tree algorithm is thus operations. 

Next, we now explicitly bound the multiplicative con¬ 
stant hidden in the above O notation, as well as compute 
the required memory for the rectangular partition. Recall 
that in the RPT, the root level j = 0 represents the orig¬ 
inal n X n image, whereas the next level, j = 1, con¬ 
tains two equal rectangles of size n x n/2. In general, ev¬ 
ery even level j includes squares of size n/2-^/^ x n/2-^/^ 
pixels, while every odd level j includes rectangles of size 


We next derive the number of stored responses per level. 
At every tile of even level j, we store the edge responses of 
curves that pass from one side of a tile to a different side. 
The number of stored responses thus equals the product of 
4 choose 2 (pairs of rectangle sides) with the tile area, 

^ ■ n/2-^'/2 X n/2^/^ = 6N/2\ (4) 


This equation holds roughly also for the odd levels. Con¬ 
sequently, multiplying Eq. (4) by the number of tiles, gives 
that the total number of stored curves at level j is 

6N/2^ X 2^ = 6N. (5) 

Space Complexity. Since the number of curves in each 
level is 6N, the number of levels is bounded by log N and 
the storage per curve is constant, the total required space is 
0{N log N). 

Basic Algorithm Complexity. First, recall that at the 
bottom level, for every leaf we scan all the straight lines 
that begin on one side of the tile and end on another side. 
Since the number of operations required to compute each 
such response is bounded by a constant, the total number of 
operations at this level is 0{N). 

Next, at every coarser level j, we build each curve by 
concatenating two shorter curves of level j-f 1, that share 
a common endpoint at the joint interface. The work done at 
level j is thus bounded by the number of calculated curves 
times the length of the tile joint interface. Since the former 
is 6N, the overall number of operations in an even level is 

m X n/2^'/2 = (6) 

while the number of operations in an odd level is 

6N X (7) 

Denote by C(A^) the time complexity of the algorithm that 
considers all the possible points on the interface. By sum¬ 
ming these over all scales we get the following. 


j odd 


J even 


C{N) « 6N^-^ 
Consequently, 


( 8 ) 


. 1=0 


1=1 


= 18N 


1.5 


( 9 ) 


Optimized Algorithm Complexity. As described in 
Sec. 3.3, the optimized variant scans, for each of the 6A^ 
pairs of start and end points, only the best k pixels in the 
joint interface. Overall, it goes over 6Nk curves at each 
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level j. Additional work is required to select the best k pix¬ 
els. Since the number of tiles equals 2^ and the interface 
length is ^ n/2-^/^, the number of operations of this step 
is bounded by log k x 2^ x n/2-^/^ < for every level j. 
To conclude, the total number of operations at each level is 
no more than {6k + 1)A^. Thus, the overall complexity is 
bounded by {6k-\-l)N log N, which significantly improves 
the overall runtime. 


5. Detection Threshold and Search Space Size 

As described in Sec. 3, our method scans a huge set of 
candidate curves. For many pairs of start and end pixels, 
the algorithm stores in the data structure BC, the curved 
edge with highest edge score, as defined by Eq. (11) be¬ 
low. Clearly, for most images, the vast majority of these 
responses do not trace actual image edges and should be 
discarded. This task requires the determination of a suitable 
threshold, possibly dependent on edge length, such that only 
edge responses above it are retained. 

Previous work [1] introduced such a theoretical thresh¬ 
old, designed to control the average number of false pos¬ 
itive detections. To this end, consider a pure noise image 
I = Inoise, where Inoise{x,y) ~ By definition, 

this image contains no real edges, and so, with high prob¬ 
ability, all of its edge responses should be discarded. Sup¬ 
pose that there are Kl distinct candidate edges of length L. 
Then, the corresponding threshold, T{L^Kl)^ is approxi¬ 
mately the maximal edge contrast expected in I noise among 
Kl statistically independent curves of length L. Alpert et 
al. [1] showed that 

( 10 ) 

where w is the width of the matched filter. Thus, to each 
curve of length L, we assign an edge score, defined as the 
difference between its mean contrast and the threshold. 


Score{y) = C{y)-T{L,KL). (11) 


A positive score indicates that the candidate curve traces 
an edge. Moreover, higher scores represent stronger confi¬ 
dence for this indication. 

To compute the edge score function of Eq. (11), we thus 
need to know, for each curve length L the size of the cor¬ 
responding search space size, Kl- As shown below in 
Eq. (19), for the RPT construction, this quantity is approxi¬ 
mately given by Kl ^ 6N x 2^^ for a suitable constant (3. 
Inserting this expression into Eq. eq(lO) gives 


T(L) = a 


21n(6A^ X 
wL 


( 12 ) 



Figure 5. Mean contrast threshold as a function of curve length. 
Our threshold is designed to eliminate all the false positive detec¬ 
tions with high probability. Theoretical curve is based on (12). 
Empirical threshold is produced by applying our algorithm on a 
pure noise images, and storing the maximal response for each 
curve length. 


detected. In our case, note that as N and L tend to infinity, 
the threshold in Eq. (12) converges to a finite limit, 

T^ = n{^). (13) 

Namely, our threshold is bounded from below by a posi¬ 
tive constant. Hence, our ability to detect faint edges of 
unknown shape and location, in low SNR is limited. Eig. 5 
compares the theoretical threshold of Eq. (12) to empirical 
results. The latter was computed by running our algorithm 
on a pure noise image and storing for each curve length the 
maximal response that was obtained. It can be seen that 
both curves are close one to each other, and that the graphs 
converge to « 1/2. This value is the asymptotic bound 
for the selected parameters in this simulation: width w = A, 
image size N = 129^, noise level cr = 1 and ^ = 6.66. 

5.1. Search Space Size 

We now compute the size of the search space Kl of can¬ 
didate curves of length L in the RPT. This quantity directly 
affects the contrast threshold (10). 

We first calculate the search space size of level j of the 
RPT, and then we show its connection to Kl- Denote by 
S{j) the total number of candidate curves at level j, and 
denote by S'{j) the same number, but for given fixed start 
and end points. Since by Eq. (5), the total number of stored 
curves at any level is equal to 6N, then 

S{j) = mx s'{j). (14) 

Next, to compute S'{j), recall that in the RPT, we split a 
tile V of level j into two sub-tiles Vi, V 2 of level j + 1, by 
a joint interface dVi fl dV 2 , whose length is n/2-^/^. Eor 
fixed endpoints pi, P 2 ^ dV, the quantity S' {j ) satisfies the 
following recursive formula 

S'U) = S'U + 1) X S'U + 1) X n/2^'/^ (15) 


Minimal Detectable Contrast. An interesting question, 
already raised by [1], is how faint can an edge be and still be 
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In order to apply the master theorem [8], we take logarithm 
on both sides 

log S'U) = 2 log + 1) + ^ log(Af/2^'). (16) 

Substitute A = N/2 ^, which is exactly the number of pixels 
in a tile at level j, and define S{A) = S'(j). Then, 

log 5(A) = 2 log 5(^/2) + i log (17) 

According to [8], log 5(A) = 0{A). Subsequently, 

S'{j) = and combining this with Eq. (14), 

S{j) = 6N X (18) 

To derive an expression for it can be shown, that the 
average length over all candidate curves in a given tile at 
level j is proportional to the tile’s area: L = 0{N/2^). 
Therefore we can approximate iTi,, by 

Kl^QN X 2^^ (19) 

for some constant /S. As mentioned above, we showed em¬ 
pirically that (3 = 0.65. 

We remark that even though the search space is exponen¬ 
tial in L, there are nonetheless various curves that cannot be 
found by the RPT. Examples of such curves include closed 
curves like a circle, self-intersecting curves like a cross, and 
also any curve that begins and ends in the same side of a 
tile, like a narrow ’V’ shape. Such geometric objects are 
detected by our algorithm as union of shorter valid curved 
edges. 

6. Experiments 

We tested our algorithm both on simulated artificial im¬ 
ages, and on challenging real images from several applica¬ 
tion domains. Our code is implemented in Eurther- 
more, as our tree construction can be easily parallelized, 
our code uses multi-threading. We ran our experiments on 
an 8-core Intel i7, 16 GB RAM single machine. Eor an input 
image of size 129 x 129 pixels our run times are ~ 2 sec¬ 
onds for the 0{N log N) version and 4 seconds for the 
both including the post processing step of com¬ 
puting the final edge map image E. Eor an input image of 
257 X 257 pixels the corresponding run-times are 10 and 

30 seconds respectively. More CPU cores or utilization 
of a GPU can reduce these run times significantly. Pig. 6 
shows the empirical and theoretical run-times as a function 
of image size. Our implementation outputs the edge image 
together with a list of all the curved edges that passed the 
statistical threshold. We compared our solution to the clas¬ 
sical Canny [7] algorithm, and to several state of the art al¬ 
gorithms for boundary detection in natural images, includ¬ 
ing Multiscale Combinatorial Grouping (MCG) [4], Crisp 
boundary detection [14] and Dollar and Zitnick [10]. 




Figure 6. Left: A binary pattern used in simulation experiments. 
Right: Empirical run-time of our implementation compared to the 
theoretical run-time for both 0{N log N) and modes. 

Simulations. Eor the simulations, we used a binary pat¬ 
tern of size 129 x 129 pixels, contains straight lines, con¬ 
centric circles and an ’S’ shape, see Pig. 6. We then scaled 
the intensities and added additive Gaussian noise with 0.1 
standard deviation to produce images with SNRs between 
0.6 and 2.6 in intervals of 0.2. In addition, we add a very 
weak salt and pepper noise that affects only 1% of the pix¬ 
els in the images. We used the result of Canny on the clean 
binary pattern as the ground truth. We quantitatively com¬ 
pared the various edge detection algorithms by computing 
their Precision (P), Recall (P), and P-score, using the pop¬ 
ular P-measure for image segmentation described in [16]. 

Table 1 shows the average P-scores obtained for each al¬ 
gorithm. A graph of the P-scores as a function of SNR is 
shown in Pig. 7. As expected, algorithms geared to de¬ 
tecting boundaries in natural images do not perform well 
in such noisy conditions. Canny manages to obtain fairly 
high P-scores. It is important to note that to obtain these 
results we had to modify Canny’s default thresholds. We 
thresholds used [low, high] = [0.26, 0.65] were in fact op¬ 
timized over to maximize its P-score in our simulations. In 
contrast, it can be seen that our algorithm achieves 

the best P-scores at all SNR levels, while our 0{N log N) 
variant achieved only slightly smaller scores. These results 
suggest that high quality detection can be obtained by our 
faster method, in spite of the significant reduction of com¬ 
plexity. Pig. 8 shows representative results of Canny and 
our method at SNR=2. 

We also made extensive evaluation of our algorithm on 
the dataset of 63 artificial images containing various straight 
and curved edges, as studied by [ 1 ]. Pig. 9 shows some rep¬ 
resentative results of our algorithm on few of these images, 
shapes at different SNRs. On this dataset our al¬ 

gorithm achieved an average P-score of « 0.79, compared 
to « 0.74 achieved by [1]. This demonstrates that our al¬ 
gorithm is not only significantly faster, but also at least as 
accurate as [1]. 

Real Images. Pinally, we tested our algorithm on vari¬ 
ous real images taken under poor conditions. Pig. 10 shows 
results on few such images. It can be seen that our method 
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Figure 7. Simulation results: F-measures obtained with various 
edge detection algorithms as a function of SNR. 


Algorithm \ SNR Range 

0.6-1.0 

1.2-2.0 

2.2-2.6 

Our detector 

0.47 

0.75 

0.88 

Our 0{N log N) detector 

0.46 

0.72 

0.87 

Canny 

0.24 

0.67 

0.85 

BMSD-^Canny 

0.12 

0.67 

0.84 

Crisp 

0.3 

0.32 

0.46 

Dollar 

0.18 

0.32 

0.43 

MCG 

0.25 

0.28 

0.41 


Table 1. Average F-measures obtained in simulations. The score 
is computed over images in three SNR ranges: from 0.6 to 1, 1.2 
to 2 and 2.2 to 2.6. 



Figure 8. Result of applying various edge detection algorithms to 
the noisy simulation image. From left to right: Input noisy image 
at SNR 2, our algorithm, Canny best result and Canny 

after BM3D denoising. 






Figure 9. Our results on the simulations of Alpert et al. [1] at SNR 

2. 


manages to accurately detect edges, even in challenging im¬ 
ages where other approaches exhibit poor results. This is 
yet another empirical demonstration that state-of-the-art al¬ 
gorithms for boundary detection [14, 10, 4] may perform 
poorly in detecting edges at low SNRs. Canny, while sig¬ 
nificantly better, still fails to detect very faint and thin edges. 
Fig. 11 shows yet another example of our and Canny results 
on underwater images of Plankton [5]. 



Figure 10. Real images: Each column shows the original image 
and a comparison of our results with those obtained by other al¬ 
gorithms. From top to bottom: The input image; our 
algorithm; Canny and Crisp. 



Figure 11. Underwater microscope example: Each row shows a 
Plankton image along with corresponding results. Prom left to 
right: the input image; our result and Canny result. 


7. Conclusion 

We presented efficient algorithms for detecting faint 
curved edges in noisy images that achieve state-of-the-art 
results in low SNRs. We introduced a novel approach for 
detecting curved edges in an image in 0{N log N) oper¬ 
ations. Importantly, the algorithm is adaptive to various 
parameters such as edge length, shape, and SNR. Thus it 
may be applicable in a variety of imaging domains. Our 
approach can be extended to efficiently detect edges in 3D 
images, which are frequently used in medical imaging. In 
addition, it may be used to find maximum paths in other de¬ 
tection tasks such as visual object tracking. Source code is 
available on line. 
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